Optical device and locus smoothing method thereof

ABSTRACT

There is provided an optical navigation device including an image sensor, a processing unit, a storage unit and an output unit. The image sensor is configured to successively capture images. The processing unit is configured to calculate a current displacement according to the images and to compare the current displacement or an accumulated displacement with a threshold so as to determine an outputted displacement. The storage unit is configured to save the accumulated displacement. The output unit is configured to output the outputted displacement with a report rate.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation application of U.S. application Ser. No. 16/047,338, filed on Jul. 27, 2018, which is a continuation application of U.S. application Ser. No. 15/217,701, filed on Jul. 22, 2016, which is a continuation application of U.S. application Ser. No. 13/871,321, filed on Apr. 26, 2013 and claims the priority benefit of Taiwan Patent Application Serial Number 101115438, filed on May 1, 2012, the full disclosure of which is incorporated herein by reference.

BACKGROUND 1. Field of the Disclosure

This disclosure generally relates to a human machine interface device and, more particularly, to an optical device and a locus smoothing method thereof capable of increasing locus smoothness.

2. Description of the Related Art

Traditionally, the optical mouse is one of the peripheral devices for interacting with the computer system having a display screen. An optical mouse generally includes a light source, an image sensor and a processing unit. The light source emits light to a working surface. The image sensor receives reflected light from the working surface and successively outputs image frames. The processing unit calculates a displacement of the optical mouse with respect to the working surface according to the image frames and sends the displacement to a computer system with a report rate for corresponding control.

However, as the image frames captured by the image sensor may contain noise, the noise will reflect in the displacement calculated by the processing unit. Although the displacement will not be obviously affected by a position offset caused by the noise when the displacement is relatively larger than the position offset, when the displacement is very small and is substantially identical to or just a little bit larger than the position offset, the locus can be disturbed to have a zigzag path.

For example referring to FIG. 1, it shows a schematic diagram of the locus outputted by a conventional optical mouse, wherein it is assumed that the optical mouse outputs the detected displacement with report rate of 125 times/second.

For example, now a user slowly moves the optical mouse along an X direction. When there is no noise in the image frame, the optical mouse can output the locus of a straight line as shown by the dashed line. However, when there is noise in the image frame, such as +Δy noise existing at 16 ms and 56 ms and −Δy noise existing at 24 ms and 48 ms, the optical mouse will output the locus having a zigzag path. This zigzag locus can significantly affect the operation of a user in fine operation.

Accordingly, the present disclosure further provides an optical navigation device and a locus smoothing method thereof that can effectively eliminate or significantly reduce the zigzag locus outputted by a conventional optical mouse.

SUMMARY

The present disclosure provides an optical device and a locus smoothing method thereof that may output a zero displacement when an accumulated displacement does not exceed a displacement threshold or an accumulated parameter does not exceed a predetermined accumulation value thereby eliminating the noise interference.

The present disclosure provides an optical device including an image sensor and a processing unit. The image sensor is configured to successively capture images. The processing unit is coupled to the image sensor and configured to calculate a current displacement according to the captured images and compare the current displacement with a threshold. When the current displacement is smaller than the threshold, the processing unit outputs a zero displacement to the external electronic device and accumulates the current displacement to an accumulated displacement. When the current displacement is larger than or equal to the threshold, the processing unit outputs the current displacement without accumulating the current displacement to the accumulated displacement.

The present disclosure further provides a locus smoothing method of an optical device for smoothing displacements sent to an external electronic device. The optical device includes an image sensor and a processing unit. The locus smoothing method includes the steps of: successively capturing, by the image sensor, images; calculating, by the processing unit, a current displacement according to the captured images; comparing, by the processing unit, the current displacement with a threshold; when the current displacement is smaller than the threshold, accumulating the current displacement to an accumulated displacement, calculating, by the processing unit, a next current displacement, and directly accumulating the next current displacement to the accumulated displacement; outputting the accumulated displacement to the external electronic device when the accumulated displacement is larger than or equal to the threshold; and outputting a zero displacement to the external electronic device when the accumulated displacement is smaller than the threshold.

The present disclosure further provides a locus smoothing method of an optical device for smoothing displacements sent to an external electronic device. The optical device includes an image sensor and a processing unit. The locus smoothing method includes the steps of: successively capturing, by the image sensor, images; calculating, by the processing unit, a current displacement according to the captured images; comparing, by the processing unit, the current displacement with a threshold; outputting the current displacement when the current displacement is larger than or equal to the threshold; and accumulating the current displacement to the accumulated displacement and outputting a zero displacement to the external electronic device when the current displacement is smaller than the threshold.

In the optical device and the locus smoothing method according to the embodiment of the present disclosure, when an accumulated parameter counted by a counting unit is larger than or equal to a predetermined accumulation value, the accumulated displacement or an average displacement of the accumulated displacement is outputted so as to avoid accumulating the displacement for a long time.

In the optical device and the locus smoothing method according to the embodiment of the present disclosure, when a current displacement is smaller than the threshold, the processing unit may directly accumulate the obtained next current displacement to the accumulated displacement and does not compare the next current displacement with the threshold. When the accumulated displacement is larger than or equal to the threshold, the accumulated displacement is outputted for one time or an average displacement of the accumulated displacement is outputted for several times, wherein an output time of outputting the average displacement may be determined according to the accumulated parameter, which may be an accumulated number of the current displacement being accumulated or an accumulation interval of accumulating the current displacement. When the accumulated displacement is smaller than the threshold, a zero displacement may be outputted.

BRIEF DESCRIPTION OF THE DRAWINGS

Other objects, advantages, and novel features of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

FIG. 1 shows a schematic diagram of the locus outputted by a conventional optical mouse.

FIG. 2A shows a schematic diagram of the optical navigation device according to an embodiment of the present disclosure.

FIG. 2B shows a schematic block diagram of the optical navigation device according to an embodiment of the present disclosure.

FIG. 3 shows a flow chart of the locus smoothing method of the optical navigation device according to an embodiment of the present disclosure.

FIG. 4 shows an operational schematic diagram of the locus smoothing method of the optical navigation device according to the embodiment of the present disclosure.

DETAILED DESCRIPTION OF THE EMBODIMENT

It should be noted that, wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.

Referring to FIGS. 2A and 2B, FIG. 2A shows a schematic diagram of the optical navigation device according to an embodiment of the present disclosure; and FIG. 2B shows a schematic block diagram of the optical navigation device according to an embodiment of the present disclosure.

The optical navigation device 1 includes a housing 10, a light source 11, an image sensor 12, a processing unit 13, an output unit 14, a counting unit 15 and a storage unit 16. In one embodiment, the optical navigation device 1 may further include a light control unit 17 configured to control the turning on and the turning off of the light source 11, and the light control unit 17 may be included in the processing unit 13 or separated therefrom. The optical navigation device 1 is configured to be put on a working surface S for being operated by a user.

A bottom surface of the housing 10 has an opening H. The light source 11 may be a light emitting diode, a laser diode or other active light sources and preferably is configured to irradiate red light or invisible light to illuminate the working surface S through the opening H.

The image sensor 12 may be a CCD image sensor, a CMOS image sensor or other sensors capable of detecting light energy. The image sensor 12 receives reflected light reflected from the working surface S and passing through the opening H at a sampling frequency to successively capture and output images.

The processing unit 13 may be a digital signal processor (DSP). After receiving the images sent from the image sensor 12, the processing unit 13 calculates a current displacement according to the images, compares the current displacement or an accumulated displacement with a threshold so as to determine and output an outputted displacement. In one embodiment, when the processing unit 13 identifies that the current displacement is larger than or equal to the threshold, the processing unit 13 controls the output unit 14 to output the current displacement; that is, the outputted displacement is the current displacement. When the processing unit 13 identifies that the current displacement is smaller than the threshold, the current displacement is accumulated to an accumulated displacement and then stored in the storage unit 16; meanwhile, the processing unit 13 controls the output unit 14 to output a zero displacement (i.e. the outputted displacement is 0) and directly accumulates a next current displacement to the accumulated displacement. At this moment, the processing unit 13 may or may not compare the next current displacement with the threshold. Then, when the processing unit 13 identifies that the accumulated displacement is larger than or equal to the threshold or identifies that an accumulated parameter is larger than or equal to a predetermined accumulation value (described later), the processing unit 13 may further calculate an average displacement of the accumulated displacement and control the output unit 14 to output the accumulated displacement for one time or to output the average displacement for several times; that is, the outputted displacement may be the accumulated displacement or the average displacement. It should be mentioned that if the accumulated displacement is outputted by the processing unit 13, the average displacement may not be calculated. When the processing unit 13 identifies that the accumulated displacement is smaller than the threshold and the accumulated parameter is smaller than the predetermined accumulation value, the processing unit 13 controls the output unit 14 to output a zero displacement; that is, the outputted displacement is 0.

The output unit 14 wired or wirelessly sends the outputted displacement to an electronic device 9 at a fixed report rate, e.g. 120 times/second or 125 times/second so as to perform corresponding control, wherein the method of an optical navigation device controlling an electronic device is well known to the art, e.g. controlling a cursor or an application using an optical mouse, and thus details thereof are not described herein. The present disclosure is to smooth the outputted displacement of the optical navigation device 1. In addition, the report rate mentioned above is only exemplary and is not used to limit the present disclosure.

The counting unit 15 is configured to count an accumulated parameter, e.g. counting an accumulated number of the current displacement being accumulated or an accumulation interval of accumulating the current displacement so as to avoid a long accumulation interval or a high accumulated number of the current displacement that could affect the operation of the user. Therefore in this embodiment, the processing unit 13 may further compare the accumulated parameter with a predetermined accumulation value. When the accumulated parameter is identified to be larger than or equal to the predetermined accumulation value, the processing unit 13 may further calculate an average displacement of the accumulated displacement and control the output unit 14 to output the accumulated displacement for one time or to output the average displacement for several times, wherein an output time of the output unit 14 outputting the average displacement may be determined according to the accumulated parameter, e.g. the output time may be equal to the accumulated number (described later with an example). As mentioned above, if the accumulated displacement is outputted by the processing unit 13, the average displacement may not be calculated.

The storage unit 16 is configured to store the threshold, accumulated displacement, accumulated parameter and/or predetermined accumulation value.

Referring to FIG. 3, it shows a flow chart of the locus smoothing method of an optical navigation device according to an embodiment of the present disclosure including the steps of: successively capturing images (Step S₁₁); calculating a current displacement ΔΔD according to the images (Step S₁₂); comparing the current displacement ΔD with a threshold TH (Step S₁₃); outputting the current displacement ΔD when the current displacement ΔD is larger than or equal to the threshold TH (Step S₁₄); when the current displacement ΔD is smaller than the threshold TH, accumulating the current displacement ΔD to an accumulated displacement ΣΔD, counting an accumulated parameter C and outputting a zero displacement (Step S₁₅); successively capturing images (Step S₁₁′); calculating a next current displacement ΔD (Step S₁₂′); directly accumulating the next current displacement ΔD to the accumulated displacement ΣΔD and counting the accumulated parameter C (Step S₁₆); comparing the next current displacement ΔD or the accumulated displacement ΣΔD with the threshold TH and comparing the accumulated parameter C with a predetermined accumulation value N (Step S₁₇); when the accumulated displacement ΣΔD or the next current displacement ΔD is larger than or equal to the threshold TH or when the accumulated parameter C is larger than or equal to the predetermined accumulation value N, outputting the accumulated displacement ΣΔD for one time or outputting an average displacement AveΣΔD of the accumulated displacement ΣΔD for several times (Step S₁₈); when the accumulated displacement ΣΔD and the next current displacement ΔD are both smaller than the threshold TH and the accumulated parameter C is smaller than the predetermined accumulation value N, outputting a zero displacement (Step S₁₉).

Referring to FIGS. 3 and 4, the locus smoothing method of the optical navigation device according to an embodiment of the present disclosure will be described hereinafter using an example.

Step S₁₁:

The image sensor 12 successively captures images at a sampling frequency. At this moment, the accumulated displacement ΣΔD saved in the storage unit 16 is equal to zero; i.e. ΣΔD=0.

Step S₁₂:

For example at time t₁, the processing unit 13 receives the images to accordingly calculate a current displacement ΔD.

Step S₁₃:

The processing unit 13 compares the current displacement ΔD with a threshold TH so as to determine the current displacement ΔD is outputted or accumulated.

Step S₁₄:

When the current displacement ΔD is larger than or equal to the threshold TH, the processing unit 13 outputs the current displacement ΔD to the output unit 14 so as to transmit the current displacement ΔD to an external electronic device 9 through the output unit 14. The procedure returns to the Step S₁₁ to perform a next detection of displacement.

Step S₁₅:

When the current displacement ΔD (e.g. ΔD₁ shown in FIG. 4) is smaller than the threshold TH, the processing unit 13 accumulates the current displacement ΔD₁ to the accumulated displacement ΣΔD (i.e. 0+ΔD₁) saved in the storage unit 16; meanwhile, the counting unit 16 counts an accumulated parameter C, which may be an accumulated number of the current displacement being accumulated (e.g. 1 by now) or an accumulation interval of accumulating the current displacement (e.g. 8 ms by now), to be saved in the storage unit 16; meanwhile, the processing unit 13 outputs a zero displacement to the output unit 14 and the output unit 14 sends the zero displacement to the external electronic device 9. The procedure then performs a next detection of displacement.

Next, the image sensor 12 successively captures images at the sampling frequency (Step S₁₁′); the processing unit 13 receives the images to accordingly calculate a next current displacement ΔD (Step S₁₂′), such as ΔD₂ shown in FIG. 4. At this moment, the accumulated displacement ΣΔD stored in the storage unit 16 may not be zero (e.g. ΔD₁ by now). It is appreciated that in the steps S₁₁ and S₁₁′ the same image sensor 12 is used to capture images; and in the steps S₁₂ and S₁₂′ the same processing unit 12 is used to calculate the current displacement; and these steps are separated in FIG. 3 for clearly showing the procedure.

Step S₁₆:

The next current displacement ΔD₂ is directly accumulated to the accumulated displacement ΣΔD (e.g. ΔD₁+ΔD₂). The counting unit 15 continuously increases the counting parameter C. In other words, if the accumulated displacement ΣΔD stored in the storage unit 16 is not zero, when the processing unit 13 obtains a new current displacement ΔD, the processing unit 13 may directly accumulate the new current displacement ΔD to the accumulated displacement ΣΔD. The processing unit 13 does not compare the new current displacement ΔD with the threshold TH to determine whether to accumulate the current displacement ΔD or not.

Steps S₁₇˜S₁₈:

The processing unit 13 compares the accumulated displacement ΣΔD with the threshold TH and/or compares the accumulated parameter C with a predetermined accumulation value N. When the accumulated displacement ΣΔD is larger than or equal to the threshold TH and/or the accumulated parameter C is larger than or equal to the predetermined accumulation value N, the processing unit 13 outputs the accumulated displacement ΣΔD or an average displacement AveΣΔD of the accumulated displacement ΣΔD. For example, the processing unit 13 may control the output unit 14 to output the accumulated displacement ΣΔD for one time or to output the average displacement AveΣΔD of the accumulated displacement ΣΔD for several times. In another embodiment, the processing unit 13 may also compare the next current displacement ΔD₂ with the threshold TH and output the accumulated displacement ΣΔD or the average displacement AveΣΔD of the accumulated displacement ΣΔD when the next current displacement ΔD₂ is larger than or equal to the threshold TH. In this embodiment, the processing unit 13 may determine an output time of outputting the average displacement AveΣΔD according to the accumulated parameter C.

For example in the embodiment shown in FIG. 4, it is assumed that a current displacement ΔD₄ or the accumulated displacement ΣΔD=ΔD₁+ΔD₂+ΔD₃+ΔD₄ is larger than or equal to the threshold TH and/or the accumulated parameter C at time t₄ is larger than or equal to the predetermined accumulation value N (e.g. N=4 or 32 ms). The processing unit 13 controls the output unit 14 to output the accumulated displacement ΣΔD for one time at time t₄ or controls the output unit 14 to output an average displacement AveΣΔD of the accumulated displacement ΣΔD (e.g. AveΣΔD=ΣΔD/4) at time t₄, and further output (the average displacement AveΣΔD+ current displacement ΔD₅) at time t₅, and further output (the average displacement AveΣΔD+ current displacement ΔD₆) at time t₆, and further output (the average displacement AveΣΔD+ current displacement ΔD₇) at time t₇. More specifically, the processing unit 13 may output the average displacement AveΣΔD for several times according to the accumulated parameter C, and an accumulated number of the current displacement ΔD being accumulated may be set as an output time of outputting the average displacement AveΣΔD. In other words, in FIG. 4 if the processing unit 13 outputs the accumulated displacement ΣΔD for one time, the procedure is returned to the Step S₁₁ at time t₅; however, if the processing unit 13 outputs the average displacement AveΣΔD for several times, the procedure is returned to the Step S₁₁ at time t₈. It should be mentioned that when the average displacement AveΣΔD is outputted for several times, within the period outputting the average displacement AveΣΔD, e.g. at time t₅˜t₇ of FIG. 4, the locus smoothing method of FIG. 3 may not be performed and a current displacement ΔD obtained may be directly added to the average displacement AveΣΔD and the summation thereof is directly outputted. After the average displacement AveΣΔD is all outputted, e.g. at time t₈ of FIG. 4, the locus smoothing method of the present embodiment is performed again. It is appreciated that, the output time of outputting the average displacement is not limited to the accumulated number, and it may be a fixed number of times or a multiple of the accumulated number without any limitation.

Step S₁₉:

When both of the next current displacement ΔD₂ and the accumulated displacement ΣΔD are smaller than the threshold TH, and when the accumulated parameter C is smaller than the predetermined accumulation value N, the processing unit 13 outputs a zero displacement to the output unit 14 to be sent to the external electronic device 9 through the output unit 14, and the procedure is returned to the Step S₁₁′ to calculate a next current displacement, e.g. ΔD₃. Next, the Steps S₁₆, S₁₇ and S₁₉ are performed repeatedly till the current displacement ΔD, the accumulated displacement ΣΔD and/or the accumulated parameter C satisfy the condition in the Step S₁₇ (as mentioned above), and then the accumulated displacement ΣΔD is outputted for one time or the average displacement AveΣΔD of the accumulated displacement ΣΔD is outputted for several times.

It should be mentioned that the step S₁₇ of FIG. 3 shows that the processing unit 13 may compare the next current displacement ΔD with the threshold TH or compare the accumulated displacement ΣΔD with the threshold TH. It is known that when the next current displacement ΔD is larger than or equal to the threshold TH, the accumulated displacement ΣΔD is naturally larger than or equal to the threshold TH. Therefore in step S₁₇, it is able to only compare the accumulated displacement ΣΔD with the threshold TH and it is not necessary to compare the next current displacement ΔD with the threshold TH.

As mentioned above, conventional optical mouse may output zigzag locus in tiny displacement such that the operation accuracy may be degraded. Therefore, the present disclosure further provides an optical navigation device (FIGS. 2A and 2B) and a locus smoothing method thereof (FIG. 3) that may output a zero displacement when an accumulated displacement does not exceed a displacement threshold and an accumulated parameter does not exceed a predetermined accumulation value. The accumulated displacement is outputted for one time or an average displacement of the accumulated displacement is outputted for several times till the accumulated displacement exceeds the displacement threshold or the accumulated parameter exceeds the predetermined accumulation value. In the present disclosure, as the outputted displacement is relatively larger than the noise, it is able to eliminate the interference from the noise on tiny displacement.

Although the disclosure has been explained in relation to its preferred embodiment, it is not used to limit the disclosure. It is to be understood that many other possible modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as hereinafter claimed. 

What is claimed is:
 1. An optical device configured to be coupled to an external electronic device, the optical device comprising: an image sensor configured to successively capture images; and a processing unit coupled to the image sensor and configured to calculate a current displacement according to the captured images and compare the current displacement with a threshold, when the current displacement is smaller than the threshold, output a zero displacement to the external electronic device and accumulate the current displacement to an accumulated displacement, and when the current displacement is larger than or equal to the threshold, output the current displacement without accumulating the current displacement to the accumulated displacement.
 2. The optical device as claimed in claim 1, further comprising: a counting unit configured to count an accumulated number which is a number of times the current displacement being accumulated to the accumulated displacement.
 3. The optical device as claimed in claim 2, wherein the accumulated number is increased by 1 as long as one current displacement is accumulated to the accumulated displacement.
 4. The optical device as claimed in claim 2, wherein the processing unit is further configured to calculate an average displacement of the accumulated displacement when the accumulated number is larger than or equal to a predetermined accumulation value.
 5. The optical device as claimed in claim 4, wherein the average displacement is outputted for several times.
 6. The optical device as claimed in claim 5, wherein a number of times of outputting the average displacement is a multiple of the accumulated number.
 7. The optical device as claimed in claim 2, wherein the processing unit is further configured to output the accumulated displacement when the accumulated number is larger than or equal to a predetermined accumulation value.
 8. The optical device as claimed in claim 1, wherein the processing unit is further configured to calculate an average displacement of the accumulated displacement when the accumulated displacement is larger than or equal to the threshold.
 9. The optical device as claimed in claim 1, wherein the processing unit is further configured to output the accumulated displacement when the accumulated displacement is larger than or equal to the threshold.
 10. The optical device as claimed in claim 1, wherein the processing unit is further configured to directly accumulate a next current displacement to the accumulated displacement without comparing the next current displacement with the threshold when the current displacement is smaller than the threshold.
 11. A locus smoothing method of an optical device for smoothing displacements sent to an external electronic device, the optical device comprising an image sensor and a processing unit, the locus smoothing method comprising: successively capturing, by the image sensor, images; calculating, by the processing unit, a current displacement according to the captured images; comparing, by the processing unit, the current displacement with a threshold; when the current displacement is smaller than the threshold, accumulating the current displacement to an accumulated displacement, calculating, by the processing unit, a next current displacement, and directly accumulating the next current displacement to the accumulated displacement; outputting the accumulated displacement to the external electronic device when the accumulated displacement is larger than or equal to the threshold; and outputting a zero displacement to the external electronic device when the accumulated displacement is smaller than the threshold.
 12. The locus smoothing method as claimed in claim 11, wherein the optical device further comprises a counting unit, and the locus smoothing method further comprises: counting, by the counting unit, an accumulated number which is a number of times current displacements being accumulated to the accumulated displacement.
 13. The locus smoothing method as claimed in claim 12, wherein the accumulated number is only increased as long as one current displacement is accumulated to the accumulated displacement.
 14. The locus smoothing method as claimed in claim 12, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises: outputting the accumulated displacement or an average displacement of the accumulated displacement when the accumulated number is larger than or equal to a predetermined accumulation value.
 15. The locus smoothing method as claimed in claim 14, further comprising: outputting the average displacement for a number of times of a multiple of the accumulated number.
 16. A locus smoothing method of an optical device for smoothing displacements sent to an external electronic device, the optical device comprising an image sensor and a processing unit, the locus smoothing method comprising: successively capturing, by the image sensor, images; calculating, by the processing unit, a current displacement according to the captured images; comparing, by the processing unit, the current displacement with a threshold; outputting the current displacement when the current displacement is larger than or equal to the threshold; and accumulating the current displacement to the accumulated displacement and outputting a zero displacement to the external electronic device when the current displacement is smaller than the threshold.
 17. The locus smoothing method as claimed in claim 16, wherein the optical device further comprises a counting unit, and the locus smoothing method further comprises: counting, by the counting unit, an accumulated number which is a number of times the current displacement being accumulated to the accumulated displacement.
 18. The locus smoothing method as claimed in claim 17, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises: outputting the accumulated displacement for one time or outputting an average displacement of the accumulated displacement for several times when the accumulated number is larger than or equal to a predetermined accumulation value.
 19. The locus smoothing method as claimed in claim 18, wherein a number of times of outputting the average displacement is determined according to the accumulated number.
 20. The locus smoothing method as claimed in claim 16, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises: calculating, by the processing unit, a next current displacement; directly accumulating the next current displacement to the accumulated displacement; comparing, by the processing unit, the accumulated displacement with the threshold; and outputting the accumulated displacement for one time or outputting an average displacement of the accumulated displacement for several times when the accumulated displacement is larger than or equal to the threshold. 